Quantum routing is crucial for future networks as it utilizes entanglement and swapping to establish efficient communication paths between nodes. Although machine learning has transformed various industries, its integration with quantum networking remains relatively underexplored. To address this gap, we present the Deep Quantum Routing Agent (DQRA), an innovative deep reinforcement learning framework that optimizes routing paths to maximize request fulfillment within constrained time windows. Our approach integrates a neural network with a qubit-preserving shortest-path algorithm, employing a reward-based training system to enhance connection success rates. Extensive experiments show DQRA achieves over 80% routing success in resource-limited networks and maintains approximately 60% effectiveness under challenging single-repeater conditions. Importantly, the model demonstrates polynomial-time complexity, ensuring scalable deployment and effectively merging machine learning with quantum network optimization.
Introduction
Quantum networking boosts information security using quantum entanglement and the no-cloning theorem, which makes eavesdropping nearly impossible. Building scalable quantum networks requires optimized use of qubits and quantum repeaters. To address this, the study proposes using Deep Reinforcement Learning (DRL) to enhance entanglement scheduling and routing.
Methodology
A. Hybrid Quantum-Classical Framework
Integrates DRL with quantum simulators like NetSquid/QuNetSim.
B. State Representation
DRL inputs include network topology, qubit status, link quality, and entanglement requests.
C. DRL Architecture
Uses PyTorch/TensorFlow models trained with PPO or DQN, optimizing based on entanglement success and reduced latency.
D. Routing Algorithm
Adapts Dijkstra’s algorithm with constraints to preserve qubits and adjust path weights dynamically.
E. Training Protocol
DRL models trained on randomized data sets. Reward system:
+1 (successful entanglement)
–0.5 (failed paths)
–0.1 (per qubit used)
Results & Discussion
The proposed DRL-based Quantum Routing Algorithm (DQRA) achieved:
85–90% entanglement success in qubit-limited environments.
30–40% latency reduction over classical methods.
The hybrid method effectively handles decoherence and dynamic network changes.
Limitation: Computational overhead is still a barrier to real-world scalability.
Conclusion
In conclusion, the Deep Quantum Routing Agent (DQRA) effectively addresses the entanglement routing challenge by combining machine learning with quantum principles. Experimental results confirm its scalability and reliability, though future work is needed to reduce computational overhead and enable real-time deployment in practical quantum networks.
References
[1] S. Shi and C. Qian, “Concurrent entanglement routing for quantum networks: Model and designs,” in Proc. Annu. Conf. ACM Special Int. Group Data Commun., 2020, pp. 62–75, doi: 10.1145/3387514.3405853.
[2] C. Cicconetti, M. Conti, and A. Passarella, “Request scheduling in quantum networks,” IEEE Trans. Quantum Eng., vol. 2, 2021, Art. no. 4101917, doi: 10.1109/TQE.2021.3090532.
[3] W. Dai, T. Peng, and M. Z. Win, “Optimal remote entanglement distribution,” IEEE J. Sel. Areas Commun., vol. 38, no. 3, pp. 540–556, Mar. 2020, doi: 10.1109/JSAC.2020.2969005.
[4] C. Li, T. Li, Y.-X. Liu, and P. Cappellaro, “Effective routing design for remote entanglement generation on quantum networks,” npj Quantum Inf., vol. 7, 2020, Art. no. 10, doi: 10.1038/s41534-020-00344-4.
[5] K. Arute et al., “Quantum supremacy using a programmable superconducting processor,” Nature, vol. 574, pp. 505–510, 2019, doi: 10.1038/s41586-019-1666-5.
[6] R. V. Meter, T. Satoh, T. D. Ladd, W. J. Munro, and K. Nemoto, “Path selection for quantum repeater networks,” Netw. Sci., vol. 3, nos. 1/4, pp. 82–95, Dec. 2019, doi: 10.1007/s13119-013-0026-2.